
NPS ARCHIVE 
1966 

SMITH, C. J. 






Postgraduate school 

■Jt. CALIF. 93940 




\ y 

.03TG 



A GAME THEORY ANALYSIS OF PROPOSED STRATEGIES 



OF AN AERIAL SEARCH FOR A MOBILE SURFACE TARGET 



by 

Charles James Smith, Jr. 
Lieutenant, United States Naval Reserve 
B.S., Boston College, 1959 



Submitted in partial fulfillment 
for the degree of 

MASTER OF SCIENCE IN OPERATIONS RESEARCH 
from the 

UNITED STATES NAVAL POSTGRADUATE SCHOOL 
October 1966 



K/ PSA&mvE 

3wth,c . 

ABSTRACT 

This thesis investigates the problem of aerial search for a mobile 
surface target. The initial position of the target is known, and a 
certain amount of time elapses before the search begins. The target 
has a variety of choices as to speed and direction, and the search air- 
craft has a choice of search patterns to be flown. The method proposed 
to solve the problem of maximizing or minimizing the probability of 
detection is the game theoretic analysis of various strategies avail- 
able to the searcher and the evader. Four strategies for each are 
compared and evaluated, with optimal strategies, within the set of 
strategies investigated, being derived. 
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I. Introduction. 



A frequently encountered problem of attack aircraft is the detection 
and destruction of mobile enemy installations at some time after initial 
detection. For example, a flight may be fired upon by a mobile surface- 
to-air missile site. Upon return to the air base or carrier the location 
of the attack is reported and a strike against it is readied and sent out. 
In the meantime, the missile site has often had time to depart the posi- 
tion in which it was originally situated. There are many other ways in 
which a mobile target may be detected, such as aerial reconaissance , air- 
borne electronic detection, or visual sighting. Some of these may give 
a probabilistic rather than a deterministic position. 

The mobile target, if it knows it has been discovered, has the op- 
tions of remaining in its present position or moving. If it moves, it 
has some variety in its choices of direction and speed. Often these 
choices of movement are to some degree limited. The search aircraft are 
then confronted with the problem of finding and attacking the moving 
strike objective. This can be hampered by such variables as time to sun- 
set, terrain, weather, and other uncontrollable elements. The target may 
be found by methods other than visual if it is emitting electronic sig- 
nals, i.e., if it has not moved or if it has moved and is set up and 
operating in another position. The most difficult problem arises when 
the method of detection must be strictly visual, as when the objective 
is moving or if it has set up in another position and is not emitting. 

The degree of difficulty also depends on how much freedom of motion the 
target has. If the direction of travel is limited rather strictly, as 
when there are only a small number of roads along which it may travel 
and off-road travel is not possible, the searcher’s task is somewhat 
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simplified. If, however, it is free to travel in any or almost any direc- 
tion, the problem becomes much more difficult. This thesis examines some 
of the problems confronting a searcher faced with the problem of discover- 
ing a target with unrestricted direction of movement, and with varying 
max imum s peed s . 

This problem may be attacked in two fashions. One method is to con- 
sider the movements of the target as being determined probabilistically, 
with such variables as direction, velocity, and time of movement all being 
described by some density function, so that an estimate of its most likely 
position, or most likely set of positions, can be found using the usual 
rules of probability. In fact, all these variables have some probabilis- 
tic limitations, but within these limitations there is another influence: 
the judgment of the commander of the site. It would be somewhat naive to 
think that the commander would be guided solely by the constraints imposed 
by the state of nature. Rather, it is more reasonable to assume that he 

would try to vary his behavior within the limits of his physical con- 

: 

straints so as to attain maximum liklihood of evasion. If this did not 
occur immediately, then certainly experience would lead him to adopt more 
sophisticated evasive tactics. The intelligent searcher would then alter 
his search pattern to counter the evasive tactics to as great a degree as 
possible. This development brings the problem into the area of game 
theory, and it is with this aspect that this paper concerns itself- 

To simplify the problem a number of probabilistic variables are 
treated deterministically. The effect of weather, time of day, terrain 
and variance in terrain over the search area, and other external influ- 
ences are ignored. These and other assumptions are discussed in the next 
section. A small number of strategies for both searcher and evader are 
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discussed. While an attempt has been made to consider the most advan- 
tageous strategies, there are probably many of merit which have not been 
included. It is felt that an approach has been made to the solution of 
the problem, however, and some possibly beneficial tactics derived. 

The general approach is to select several tactics, both for the 
searcher and the target. These tactics are then evaluated in pairwise 
combinations, using game theory criteria. This allows conclusions to be 
drawn concerning the relative merits of the strategies. 

The next section presents the basic assumptions of the model and 
attempts to justify them. The ensuing sections develop the general 
theoretical framework and the specific mathematical formulations of the 
proposed strategies. After comparing these strategies, some conclusions 
as to the value of each are inferred. 
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II. Theoretical Basis for the Model. 



2.1 Assumptions. 

It would be an almost impossible task to obtain a universal solution 
to this search problem, in which all relevant factors were included. On 
the other hand, elimination of a critical variable would leave the con- 
clusions worthless. The assumptions made in the development of the model 
are set forth here in an attempt to explain its limitations and clarify 
its objectives. 

The space in which the game is played is a two-dimensional Euclidean 
geographical space. The terrain problem is ignored in that the area is 
considered to be perfectly flat, and in no way affects either target mo- 
bility or the searcher 1 s visibility. The target is free to move in any 
direction and at any velocity up to its maximum for any duration of time. 
The searcher has a fixed range sighting probability; within this range the 
probability of detection is 1.0, outside this range the probability of 
detection is 0. The searcher is capable of flying any pattern exactly. 

The initial position of the target is known exactly. The target knows 
he has been detected, and takes action accordingly. No variables such 
as weather, time of day, or other external phenomena are considered. The 
time at which the aircraft will arrive to begin his search is known to 
the target as soon as the initial detection occurs. 

There are other minor assumptions in the model. These cited are 
considered to be the most relevant. To be able to claim that the model 
has any relevance to the real world some of these assumptions must be 
just if ied. 

First, consider the playing area. Unless the terrain is extremely 
rough, the aircraft acts essentially as if it were flying above a two- 
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dimensional area. The behavior of the target is more affected by this as 
sumption. Since the target-chosen factors are speed and direction, the 
effect of terrain on these is relevant. In a real-world situation, the 
target might indeed be somewhat terrain limited. However, most missile 
and radar sites are near cities, which in turn are usually situated in 
flat terrain. Also, there is usually a heavy density of roads near any 
city, which gives the target a great degree of flexibility in its move- 
ments, both as to direction and speed. If the area around the initial 
position is not travelable in almost any direction, the problem is simpli 
fied to some extent, but is susceptible to the same type analysis as is 
proposed here. 

The assumption that the target can move at any speed up to its max- 
imum for the duration of the search is reasonable if the search aircraft 
arrive within a reasonable length of time, on the order of four hours 
after initial detection, and stay on station a moderate length of time. 
Since most attack circraft can fly at low altitudes for only about two 
hours, the total time the target must be able to keep moving is about 
six or seven hours. This is well within the capability of most mobile 
sites . 

The method of first detection of the target is often visual or photo 
graphic, in which cases the position is known exactly. If the position 
is not known exactly, the point of highest probability is usually taken 
as the true position and treated deterministically in any actual search. 
The effect of large errors in the position of the original site is not 
examined in this discussion. 

The implications of a fixed range of detection are well known and 
no further implications have arisen in this analysis. £3 J However, the 
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idea that an aircraft can fly any desired pattern exactly will strike any 
experienced aviator as a flagrant misconception. In fact, this is prob- 
ably the most critical assumption of the model. Recent years have seen 
the development of Doppler navigational equipment which enables an air- 
craft to fly a precise track, and airborne radar in a control aircraft 
can guide other aircraft over a desired pattern with good accuracy. There 
is no reason to believe that such techniques could not be applied to search 
aircraft if the situation warranted. 

Another critical assumption is that the target knows, as soon as de- 
tected, at what time the search aircraft will arrive. Some examination 
of the actual procedures reveals this assumption to be less restrictive 
than it initially appears. If the target moves, the probability of de- 
tection diminishes with time in any of the strategies considered. The 
search aircraft will therefore want to begin the search as rapidly as 
possible. The target often knows the position of the base or carrier 
from which the attack aircraft will be launched, and can therefore pre- 
dict fairly accurately their arrival time. An estimate might also be ob- 
tained from observing past arrival times. 

While these assumptions restrict the application of the model to 
a limited situation, they allow the formulation of a general mathematical 
model. Refinements of the general approach may be made to deal with 
specific deviations . 

2.2 Outline of Game Theory Approach. 

The searcher, denoted player A, and target, denoted player B, have 
available to them a large and possibly infinite set of strategies. Each 
attempts to maximize his payoff by choosing judiciously among these 
strategies. B may choose any direction and any speed up to his maximum, 
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and may stop his movement at any time. A may choose any search pattern 
over the playing area which does not exceed his range. The payoff func- 
tion for A is the probability of target detection. The payoff to B is 
either the negative of the probability of detection, -P(D), or the prob- 
ability that A does not detect B, l-P(D). If the former is defined as 
B T s payoff the game is zero-sum; if the latter the game is constant-sum 
and the sum is one. 

The set of strategies for player A is denoted H and each element of 
this strategy set is denoted o< . The set of strategies for player B is 
denoted ^ and the elements of the set are denoted y3 . The pairs of 
strategies ( ^ , /3 ) are elements of the Cartesian product of P and 
denoted Px*. The payoff to A for a given pair of strategies, 
and p> 0 , is M(^ o , ) = P(A detects B/ o< * n (b = ($ 0 )• For an opti- 

mal strategy to exist, there must exist strategies c< and p> such that 

min max M0=K , /3 ) = max min M(©<,/5) = /£) [l\l 

p <* fl ' 

Whether in fact such strategies exist has not been determined. To 
determine the existance of such strategies, either all possible strate- 
gies must be examined, or it must be proven topologically that such strat- 
egies exist. The first method is difficult due to the large number of 
possible strategies. There exist some existence theorems which pertain 
to a pursuit-and-evasion game, but none were found which were applicable 
to the game under discussion. An existence theorem developed by Ryll- 
Nardzewski Ci] which was the most general as to existence criteria, indi- 
cated that a solution involving pure strategies did not exist. 

It is also possible that an optimal solution which is a convex com- 
bination of various strategies exists. To find this, it is necessary to 
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examine the payoff matrix of the various strategies, and to apply the 
usual methods of game theory to find a solution. This requires develop- 
ing the probability of detection for various strategies. Therefore it is 
worthwhile to develop payoff functions for individually considered strate- 
gies of A and B. 

The general procedure then is to choose some strategy and some 
strategy ^ . j 3 o specifies a rule for choosing direction, speed and 

stopping point for the target. specifies a pattern to be flown over 

the playing area. The payoff is P(A detects b/c< O (i = ($ o ). These 

strategies may be probabilistic and specify a probability function for 
choosing speed or initial aircraft search point, or may be deterministic, 
such as always start the search at a radius of five miles, or always re- 
main at the initial position. If the set of attractive strategies is 
compared pairwise in this manner, the matrix of strategy payoffs is gen- 
erated . 
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III. Development of Strategies. 

3.1 Strategies Considered. 

As has been noted, there are a great many possible strategies for 
both searcher and target. After considering a large number of strategies, 
the following were selected for investigation on the basis of their intui- 
tive attractiveness or because they are frequently used in practice. A 
glossary of terms is given in table one. The strategies as proposed by 
the author are: 

* : 

i 

Player A searches over v^ in the most efficient manner which also 
searches over all directions of possible target travel, (0, 2/>). This is 
taken to be a spiral search, and the choice of the target velocities to 
be searched is determined in a game theoretic manner. 

Table I. Glossary of Terns 

v target speed 

v^ search aircraft speed 

v^ maximum target speed 
max 

Q direction of target movement or polar angular coordinate 
of aircraft position 

R aircraft range 

^in minimum time after sighting at which target may move 

T time from initial detection of aircraft arrival 
arr 

t~ T - T . or time the target has been in motion at aircraft 
0 arr mm 

arrival time 

r radius from initial target position 

Tq radius at which the aircraft starts its search 
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circumference of the i*^ circuit searched by the aircraft 
W fixed sighting range 

A diagram of a spiral search is given in Figure 1. 

. 

r 

This is essentially the same as ^ ^ with the additional condi- 
tion that the original target position is always investigated. 



C< . 

3 

The aircraft search randomly in the circle of radius (v t " t) , 

max 

or the circle within which the target must be. 



o< . 

4* 

The aircraft search uniformly over v^ and (0, 2 IT) 
The evasive strategies are 




The target chooses velocity and direction to countered ^ accord- 
ing to a game theory criteria. 




The target chooses velocity and direction to counter accord- 
ing to game theory criteria. 




The target chooses speed uniformly on (0, 
uniformly on (0, ITT ) . 



v ) and direction 
max 




The target chooses direction uniformly on (0, 2^). The target 

proceeds radially outward so as to distribute himself uniformly over the 

geographic area bounded by r = v • t. 

l max 
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II 




Figure 1 

Diagram of Spiral Search 
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3.3 Spiral Search. 

It is possible to demonstrate that a spiral search for a target 
moving radially outward from a fixed point is the most efficient way 
of searching over various target velocities, if the target direction is 
uniformly distributed on (0, 2^). This may be intuitively justified as 
follows: Suppose a searcher has a given fixed range. He desires a 

search pattern which will minimize his path length while not searching 
over any velocity range more than once. For a single circuit, i.e., a 
search of 0 from 0 to 2^, the target velocities depend upon search width 
W and the initial radius of the search, Tq. If the velocity range is to 
remain constant throughout the circuit, the search radius must move out- 
ward with the velocity which would have put the target at r^, which is 
r 0 /t 0 . If the searcher moves outward in such a manner, and increases the 
radial component of his velocity with each subsequent circuit such that 
r^ a r^ ^ - (r / t^) * t, he will not re-search any previously searched 
velocity. This pattern may be flown in several ways. The outward radial 
component of velocity may be chosen to remain uniform throughout the 
search. Another method is to vary the radial component after the comple- 
tion of each circuit, thereby flying a series of spirals joined by short 
cross-legs. While this is slightly less efficient than a continuous 
spiral, it has the advantage that it searches over a continuous target 
velocity range. This makes it more compatible with an analysis of the 
optimum velocity choices of the target, and for this reason this method 
is used. 

The equation for a single circuit is derived as follows: 

The search aircraft flies an increment of the circuit of length^ S 
in time A t. During this time the target moves radially outward with 
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velocity v^. 



r = v. t = v, — - 
t z v 



since t = 



or for a complete circuit, r = 



v 



S. 



To derive S, take 0 to be in radians. 



( 1 ) 



dS = rd0 



then since r 



S, 



v. 



dS = 



Sd9 



or 



dS 



v^ 



d0 



v„ 



Integrating, 



f- 2 !- -f~ de =* 



9 + C 0 

v 2 



or equivalently, 

(2) S 



v t 

vT 9 

c ! e + c 2 



Since (1) r = 



(3) 



dS 

d9 ’ 



v t 

c _ e * 

v 1 



Imposing boundary conditions, 



0 = 0 



r = r r 



S = 0 



v. 



c n = 



1 v t ° 



r from (3) 



v 



v o 
t 



r from (2) 
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The final forms of the expressions are 



S 



v„ 





1 ) 



r = r Q e 



— 0 

v a 



v t 

— 0 

v 

To get these expressions in a more manageable form, express e a 



as an infinite series. 



v t 

-I 9 

v. 



= 1 



+ 



2 

v t 2 
-L 9 



+ v: 



+ • . • 



For v » v , 
t a 



e v a 






1 + 



Since v is usually over 300 and v is usually less than 30, this 
a t 

is a valid approximation. 

Then 

v a v t 

S = — — r ( i + — L- 0 - 1 ) = 6r 
V+. o v_ O 



and 

v t 

r = r ( 1 + — — 9 ) 

° 

At the end of each circuit, the searcher must position himself to 
search over a new velocity increment. If the detection range either side 
of the flight path is W, the minimum velocity unsearched is (r^ + W)/ t^ , 
which is that velocity which would put the target at r^ + W at the start 
of the search. Since the search width is 2W, a radius of r^ + 2W will 
search velocities from (tq + W) / to (r^ + 3W) / if the velocity 

is assumed to be constant across the search width. This is not strictly 
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true, since — + — < — - < — — - — ; however since this dis- 



'0 



'0 



-0 



tance is small it will be ignored. For example, if W = 1, t Q = 2, then 
W/t Q is .5, which is the maximum deviation from the velocity at the cen- 
ter of the search strip. As the time increases, this deviation becomes 
smaller. 

If the target were at Tq + 2W at t^ 9 it would move radially outward 
during the time the first circuit was being flown. The time required to 
search the first velocity increment is 



J 0 



2 r, 



0 



v 



Then the initial radius for the following circuit is 

r 0 + 2w S 0 

r = r n + 2W + —2 ( — 2_) 

10 to 

The distance from the position at the end of the first circuit to the 
beginning point of the next circuit is 



2 r 0 



r 1 r l - r 0 < 1 * V t 



) = 2W + 



4W r 



0 



a 0 



tQ v a 



If r Q = 100, W = 1, v a = 300, and t Q = 2, 

r = 2 + °_ = 12.16 

2-300 

Since these cross-legs are small compared to total aircraft range, they 
will be ignored in further computations. 

Then to compute any r, it is necessary to take its position at t Q 
and to add to it the distance traveled while the aircraft was searching 
previous circuits . 



‘n " L 0 



n-1 

C s. 

r o + 2 n W i - n ^ 

r n + 2nW + ( — ) 



'0 



v 
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since 



S = 2 ff* r , 



S = 2 
n 



* [ r o 



+ 2nW + (- 



rQ + 2nW 



n-1 



n-1 



Because of the term 



i=0 



S^, a recursive relation exists. 



A solution for N = n max is possible if the total path flown is re- 
stricted by the aircraft range, or 



N 

R = £ 

i=0 

However, because of the complexity of the expression an analytic solution 

is very difficult and an iterative method of solution for the maximum 

velocity searched as a function of Tq is laborious. For these reasons a 

computer program was used to solve the expression. Thus a method exists 

for solving for the range of target velocities searched for any r Q , with 

input parameters W, R, v , v. and t n . This solution is necessarily 

a L max u 

discrete, since the rQ f s are discrete; however, any degree of accuracy 
desired is obtainable. 

3.4 Game Theory Evaluations of the Proposed Strategies. 

3.4.1 Discussion of StrategyO^ ^ . 

Using the previously derived expression for the range of velocities 

searched over for any r^, the minimum and maximum target velocities may 

be obtained. The probability of detection for any given initial search 
* 

radius, say r Q , is 
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Then 



M(C< 1’ Z 3 = p 

= P (v • (r*) 4 v ^ v (r*) Jr = r* J P /r = r* ^ 

( min o t max v o J j 0 o / o o ' 

The lower the value of the greater is the range of target vel- 
ocities searched. For the last circuit, generally not all values of 0 
are searched since the circuit must terminate when maximum range is reached. 
The target direction of travel is distributed uniformaly on (0, 2 ), which 

means the probability of detection on the last circuit is the percentage 
of the circumference searched. This probability is denoted 0^. The den- 
sity function for P(DA*q = r^j) is 




The graph of this density function is depicted in Figure 2. 

Denote the range of velocities searched by v^. The payoff function 
is M (v*, v*) = P( D / v^. = v* and v t = v*) . 

The distribution functions for v and v. are F(v ) and G(v.). These 

r t r t 

are not fixed distributions, but are any possible distributions. The ex- 
pected value of the game for two distributions F and G is denoted E(F,G). 

v t v t 

f max / L max 

E(F,G) = J j M(v^, v t ) dF(v^) dG(v t ) 

0 0 
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P(£>) 






* 



-h- 



r Q + 2 l*s*/-vs 



Cq+ 2 A/k/+»/ 






Figure 2 

Conditional Density 'Function of the Probability of Detection 
If M(v^, v^) is continuous then a solution is guaranteed. However, in 
the case of spiral search M is not continuous, and therefore no solution 
is guaranteed. However, an examination of the proof of this theorem in 
4 indicates that the requirement of a continuous payoff function may be 
too restrictive. The assumption of continuity is necessary in the proof 
to guarantee the existance of the Stieltjes integral of 



and 



f M(x, y) dF(x) 
^ M(x, y) dG(y) 
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and to guarantee the existance of certain minima and maxima over the do- 
main of the payoff function. It has not been determined if the existence 
of a solution to the problem under discussion exists. 

The existence of a game theory solution has been presumed and den- 
sity functions for the searcher and target derived. Due to the complex- 
ity of the analytic expression giving the range of target velocities 
searched for a given r^, an approximation to the solution using discrete 
values of r^ and v t has been used. 

If Tq and v are allowed to take on discrete values and the probabil- 
ity of detection derived for each combination of these discrete values, a 
matrix approximating the continuous-domained payoff function may be ob- 
tained. The degree of accuracy is dependent on the fineness of the incre- 
ments of v and r ; for purposes of the present investigation increments 
t 0 

of one unit of speed, i.e., one knot or one mile per hour were used. The 

resultant matrix is m x m+1, where m = v t . There are several meth- 

max 

ods to obtain the game theory solution of this matrix, but the precise 
methods of solution have the detriment of being extremely complex for a 
matrix of any size. For this reason an algorithm which gives an approx- 
imate solution was used. The algorithm and the computer program used to 
perform the calculations are discussed in Appendix I. An extensive dis- 
cussion with proof of convergence is given in Karlin C2] . The relevant 
properties of the method are: 

(1) An approximate strategy for A and B may be found. 

(2) Upper and lower bounds on the value of the game are generated. 

The accuracy of the solution depends on the number of iterations per- 
formed. Two thousand iterations are considered to give a usable approx- 
imation for the matrix under discussion. As an accuracy check one program 
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was run which performed twenty thousand iterations. The upper and lower 
values of the game, denoted V and V, were .1254 and .0845 for 2000 iter- 
ations and .1153 and .1017 for 20,000 iterations. The total computer 
time time for the more accurate method is four minutes and seven seconds. 
With 2,000 iterations ten sets of input parameters may be run in three 
minutes and fifty seconds. Using this program optimal strategies for A 
and B were found, with A restricted to using only spiral search. The 

strategies for searcher and target for varying v and t are tabulated 

max 0 

in Appendix II. 

3.4.2. Discussion of Strategy©^. 

All of the theory and general discussion relating to ^ is appli- 
cable to^ 2 * The same computer program with appropriate modifications 
was used to solve the payoff matrix. The range of the search aircraft 
was diminished by the radius of initial search to compensate for search- 
ing v^ = 0 on each search pattern, which had little effect on the out- 
come. This strategy forced B to always move from the position of initial 
detection, which to some extent alleviates the assumption that the time 
the target begins its movement is a deterministic rather than a probabil- 
istic quantity. The reason for this assumption is that there is a lower 
bound on the length of time the site takes to disassemble components and 
makes ready to move. If B is forced to move, the longer he is in motion 
the more difficult is the problem of detection. If B knows the initial 
position will always be searched, he is more likely to make an effort to 
become highly efficient in preparing to move, and therefore the range of 
times at which he moves cluster more closely around the minimum move time. 
The solution generated by the computer for this strategy indicates that B 
will move at a very low speed in about the same proportion that he did not 
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move when A plays strategy ^ ^ . 

3.4.3. Discussion of Strategy c< . 

This strategy requires A to search randomly in a circle of radius 

(t q • v ) • It has the advantage of not requiring any expenditure of 
max 

effort on navigation, and in fact is often used in practice. It is an 
inefficient search method and is included largely as a basis of compari- 
son for more effective strategies. The area in which it searches is not 
constant if the target is moving radially outward, and the probability 
of detection is less than is given in the following formula. However, 
since the probability of detection is low for this method, no accuracy 
was lost in the general conclusions. 

The probability of detection is given by 

-2WR 

P (D) = 1 - e A [ 3 ] 

The derivation of this formula is given by Koopman. f3J 

3.4.4. Discussion of Strategy ^ 

In this strategy A searches all velocities of B with equal likeli- 
hood, or v is distributed uniformaly on (0, v ). There is a problem 
r max 

in this strategy arising from the fact that searching some velocities 

requires less distance traveled than others. The strategy is therefore 
formulated as the sequential choice of velocities to be searched with 
each choice being uniformly distributed on the target velocity range. 

The expected probability of detection based on the expected range of 
velocities searched is used in the payoff matrix of the various strate- 
gies. 

3.4-5. Discussion of Strategies and ^3 

These strategies are defined in the course of deriving strategies 
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and 2 * As with discrete values are used to approximate 

the continuous strategy. 

3.4.6. Discussion of Strategy |3 y 

B moves at time t Q with a velocity chosen uniformly on (0, v t ) 

max 

and continues to move with this velocity throughout the time period. The 

direction of travel is chosen uniformly on (0, 27T). This distribution 

is also obtained if the target moves with velocity v and stops at 

max 

times uniformly distributed on (0, t q) where 0 denotes the minimum time 
at which the target may move. 

3.4.7. Discussion of Strategy^ y 

In this strategy player B distributes himself uniformly over the geo- 
graphical area of radius v^ • t o* The P ro ^ a ^^^^ t y °f detection is 

max 



P(D) = 



A 



where 



a = ir r z 



The distribution function in terms of radius, r, is 



F(r) = P(D) = 



t o )Z 

L max u 



The density function is 

f(r) = dF(r) 



2r 



Since r = t n v, 



dr = t Q dv 



The density function in terms of v is 

f(v) 



2 t o vt o dv 






2v 



(v t to 5 

max u 



(v t V 2 

max u 



dr 



dv 



m 
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and the distribution is 



v 9 

r r v r 

P(v. < v ) = f(v) = 7— 

J „ v t 

0 ^m 

Since strategies'^ and oi ^ have been approximated using discrete vel- 
ocity increments this strategy may be defined in velocity increments using 
the distribution function, which gives an expression compatible with 
ando( . 
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IV. Evaluation of Strategies. 

4.1. Method of Evaluation of Strategies 

The pairwise comparison of all combinations of strategies considered 
may be made and the results ^tabulated in a matrix of payoffs. Examina- 
tion of this matrix then reveals the optimum or combination of optimum 
strategies. The elements of the matrix are 



a.. = p[d|</ = o< . r, ft .] 

The general expression for the probability of detection for strategies 
o< and ^ is 



P(D) 



LLld^V Li.ia.aA- f 

£ P(r 0 = r .) P(D / r 0 = r .) = P(r Q = rft( 



i=l 



i=l 



fp(v . (r.) v v (r.)) 

V min i t max i 

The comparison of Oi ^ and and of ^ and ^3 ^ have been made in the 

solution of the game. The solution for elements a^ and may be made 
using the general formula directly. To solve for elements a^, a^, a 23* 
a 24 the following modification of the basic formula is used: 



v (r.) 
max v i' 

PCD) = £L P(r Q = r.) / f(v t ) for fi ^ and ft ^ 



L max 



i=l 



v . (r.) 

min l' 



where 



max 






f(v t ) = 



'min 



v^ - v^ 
max min 

2 

v t 

max 



for f> 



and 



max 



/ £<v t ) 



v 



min 



v - v • 
max min 



max 



for fi 
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For 0 < 3 the formula for the probability of detection of a uniformly dis- 
tributed target is used although this is not true for strategies ft , 

($2 and ft 3 * However, the low probability of detection for random search 
indicates that more precise computation is not necessary. 

For /5 ^ there is a difficulty in that path length for searching dif- 
ferent velocities is not constant. This has been handled by using the 
expected value of the path length for a single circuit. The expected 
value of v is calculated for each strategy of B and this is used to get 
the expected number of circuits. This is then used to calculate the prob- 
ability of detection. 

The expected target velocity is 

v t 

max 

E(v ) = 21 v t P(v = v ) 
t z z i 

0 



Then 



E [path length] = e[l] = 2 ^t Q E(v ) 



Thus 



E ^number of circuits] 



= e[c] = 



R 

E[hJ 



While it would be possible to solve for the exact probability of detec- 
tion of 0 < 4 for (l i and 3 this was not done since rough calculations 
indicated that such a value would be very low. The expected number of 
circuits may be used to solve for a^ directly by 



2W 

E(C) x t Q 
max 

since the target speed is distributed uniformaly on (0, v t ). The ex- 
max 

pected probability of detection for a^ has been calculated to be 
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t max 



for a single circuit. Therefore a f| /| was taken to be 



2-F r 0 



max 



(E (C) ) 



The payoff matrix for parameters R = 500, tg = 2 , W = 1 , v = 

max 



and v 2 = 300 is 
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1 


2 


3 


4 


.108 


.103 


.180 


.071 


.103 


.101 


.174 


.074 


.041 


.041 


.041 


.041 


.068 


.064 


.077 


.054 



This matrix has a saddle point at Therefore pure strategies exist 

for players A and B. It appears that searching by strategies oi and 
0^2 *- s highly desirable for player A, since the values of a^. and a 2 j 
are very close and a deviation by B from strategy fi ^ greatly increases 
the probability of detection. If B distributes himself uniformly over 
his range of velocities then A increases the probability of detection 
by more than a factor of two if strategies ^ ^ and 0< 2 are used. To 
determine whether the existence of a saddle point in this case was unique, 
values of the elements of the first two rows of the matrix were calcu- 
lated for six other sets of input parameters and in each case a saddle 
point existed at either a^ or a 
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V. Conclusions. 



5.1. Evaluations of Strategies 

The low value of strategies 3 and , the random and uniform on 
v t searches, indicate that their use in an actual situation would not be 
optimal. However, the use of a simple strategy that corrects some of the 
deficiencies of these strategies may be used. If an area search is used 
which does not re-search any area, the probability of detection will be 
approximately 

2WR 



This is very slightly less than the probability of detection using strat- 
egies and the spiral searches, and is very much simpler to apply. 

It must be concluded that a uniform geographic distribution of the 
target is optimal in the set of strategies discussed. Since no counter 
to this strategy seems to exist, this may well be an optimal solution 
over all strategies available to player B. If the equation for probabil- 
ity of detection used for non-overlapping flight path over a circle of 

radius v ' t^ is used, a very close approximation to the probability 
max 

of detection given by the saddle point is obtained. This indicates that 
strategies ^ ^ and 2 are optimal in the set of strategies studied by 
virtue of their characteristic of non-overlapping flight paths rather 
than because they derive an advantage because of some other characteris- 
tic. If this is true and if B plays strategy^ uniform geographical 
distribution, the effort needed to apply strategies o* ^ andO< ^ seems 
unjustified. However, the distinction between uniform geographical dis- 
tribution and uniform velocity distribution is not obvious, and conceiv- 
ably a naive player B could choose to play strategy (!> and distribute 
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f 

\ 

uniformly on (0, t t )• Since using strategies ^ or i n this case 

max 

would considerably increase the probability of detecting the target, the 
anticipated benefits might outweigh the increased effort. This might be 
augmented by an attempt to estimate the type of strategy applied by the 
evader by goodness-of-f it tests, to determine the probability that B is 
using some strategy other than (3 ^ and to use a counter-strategy which 
takes maximum advantage of B’s mistakes. 
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APPENDIX I 



Computer Program for Solving for Strategies ^ and ^ 

This program has two basic parts. The first develops the range of 
target velocities searched for various values of r^ using a spiral search, 
and generates a payoff matrix using increments of one unit of speed be- 
tween successive values of Tq and v t . The second part of the program 
solves the matrix using a method for approximating the solution of matrix 
games . 

The inputs are: 



RO 


initial radius searched 


VA 


search aircraft speed 


TO 


length of time the target has been in motion when 
search begins 


RNG 


search aircraft range 


DELR 


amount the initial radius is incremented for each 
successive search 


W 


search width 


TMAX 


maximum target speed 



The outputs are: 



VMIN 


minimum target speed searched for a given RO 


VMAX 


maximum target speed searched for a given RO 


THETA 


percent of circle searched on last circuit 


RO 


radius corresponding to VMIN, VMAX and THETA on same 
line of printout 


A 


matrix of detection probabilities 


X(i) 


approximation of optimum percent of time the search 
should start at RO equal to i • tg + W 


Y(i) 


optimum percent of time the target should choose 

v t = i - 1 
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VI 



upper value of game 



V2 lower value of game 

Internal symbols are: 

SUM total distance flown 

S circumference of present circuit 

SLAST percent of circumference searched on last circuit 

VT(j) target velocity equal to (j-1) 

v t 

L max 

SUMA (IA) ^ j for j SUMB(j) is maximum over j 

i=l 



SUMB (IB) 



v 



t +1 
u max 



j = l 



a. . for i 
1 > J 



. £ SUMA(i) is minimum over i 



NA minimum SUMB (j) 

NB maximum SUMA (i) 

YB (IE) number of times the target has picked velocity YB 
(IE - 1) 

XA (IX) number of times the search aircraft has picked initial 
velocity searched XA— IX up to present iteration. 

This program is written in Fortran 63 for use on the CDC 1604 com- 
puter. The first part of the program uses the equation developed in 
Section 3.3 to generate minimum and maximum target velocities searched 
for various values of RO . The initial RO is an input to the program, as 
is the increment of RO, designated DELR. For purposes of this investi- 
gation increments of one unit of speed were desired, and therefore the 
statement DELR = TO has been inserted. RO normally begins at W, which 
assures search of the initial target position. Each successive RO de- 
fines a row of the payoff matrix. After VMIN and VMAX are found, the 
spectrum of target velocities are subjected to IF tests to find if they 
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fall within or without the detected velocities. They are assigned prob- 
abilities of detection of 0 or 1. Then the element of the row correspon- 
ding to VMAX is assigned a probability of detection THETA. This process 
is continued until RO = VTMAX * TO. At this point the matrix is com- 
plete. 

Part II of the program obtains an approximate game theory solution 
for t is matrix. Obtaining an exact solution for a large matrix is diffi- 
cult unless a saddle point exists, which requires that 



no saddle point exists. 

The exact methods of computation involve examination of all adjoints 
of the submatrices of the matrix. The generation of the adjoints re- 
quires evaluation of the inverse and the determinant of the submatrix. 



fore a method approximating the actual solution has been used. This uses 
an iterative process in which player A chooses his strategy by looking 
at the column vector which is the sum of all columns chosen by B, and 
playing the row corresponding to the maximum element in this vector. B 
looks at a row vector composed of the sum of all rows chosen by A and 
chooses the minimum element for his next play. The number of times each 
strategy is chosen divided by the total number is an approximation of 
the optimal strategies. The minimum element in the row vector and the 
maximum element in the column vector divided by the number of iterations 
give lower and upper bounds on the value of the game. 




min max a. . 

j i J 



But for each j in the matrix there exists an element a. . such that 
a.- * = 0. For each i there exists an a. . such that a. . 0. Therefore 



The number of submatrices of a 30 x 30 matrix is There- 

of 
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The row vector of sums is SUMB in the program, and the column vector 
of sums is SUMA. The number of times each row and column has been chosen 
are XA and YB. Statements 70 through 80 choose the maximum over SUMA. 
Statements 74 through 77 choose the minimum over SUMB. 

The program as presented generates the solution for strategy^ 

To obtain the matrix and solution for strategy ^ , statement 97 and the 
preceding statement may be deleted, along with the fourth statement after 
statement 17. 
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